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Adaptive, Deterministic Ant Routing Approach For Updating Network Routing 

Information 

RELATED APPLICATIONS 
[0001] The present application is related to the following U.S. Patent Application, the entire 
contents of which are incorporated herein by reference for all purposes: U.S. Patent Application 
Serial No. 10/382,639, filed on March 5, 2003, entitled METHOD AND APPARATUS FOR 
UPDATING PROBABILISTIC NETWORK ROUTING INFORMATION, by Fuyong Zhao and 
Bruce Moon. 

FIELD OF THE INVENTION 
[0002] The present invention generally relates to routing algorithms for computer networks. 
The invention relates more specifically to an adaptive, deterministic ant routing approach for 
updating network routing information. 

BACKGROUND OF THE INVENTION 
[0003] The approaches described in this section could be pursued, but are not necessarily 
approaches that previously have been conceived or pursued. Therefore, unless otherwise 
indicated herein, the approaches described in this section are not prior art to the claims in this 
application and are not admitted to be prior art by inclusion in this section. 
[0004] Computers may communicate with each other through a network by sending data 
packets to each other. While there are numerous protocols according to which one computer 
may address a data packet to another computer, a protocol commonly used for this purpose is 
Internet Protocol (IP). Typically, a data packet that is structured according to IP (an "IP data 
packet") contains a source IP address and a destination IP address. By examining a destination 
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IP address contained in an IP data packet, a network device can determine the identity of a 
computer to which the IP data packet ultimately should be transmitted. 
[0005] The computer that originates an DP data packet (the "originating computer") is often 
not directly connected to the computer for which the IP data packet is destined (the "destination 
computer"). The originating computer and the destination computer often transmit IP data 
packets through several interconnected intermediate network devices, such as network routers. 
Each router maintains a routing table that contains information that the router uses to select one 
of potentially several directly connected network devices to which the router should forward an 
IP data packet. Because each such directly connected network device is connected to a router 
port, the router selects one of potentially several ports through which to forward the packet. 
[0006] By communicating the information in their routing tables to other routers and 
updating their routing tables based on information received from other routers, routers can 
attempt to "learn" from each other the network routes, or paths, from different sources to 
different destinations. Routers communicate such routing table information using a routing 
protocol. Some examples of routing protocols are distance vector protocols, such as Routing 
Information Protocol (RIP), and link state protocols, such as Open Shortest Path First (OSPF) 
protocol. RIP is described in the Internet Engineering Task Force (IETF) Request For 
Comments (RFC) 1058. OSPF is described in IETF RFC 1247. 

[0007] Di Caro, G. and Dorigo, M. (1998) "Ant Net: Distributed Stigmergetic Control for 
Communications Networks," Journal of Artificial Intelligence Research (JAIR), 9:317-365, 
describes a theoretical probabilistic routing approach. This "Ant Net" approach is modeled after 
the behavior of ants, which determine a best path to a destination by stochastically selecting 
between paths based on pheromones deposited on such paths by other ants. As more ants follow 
a particular path, more pheromones are deposited on the particular path relative to other paths. 
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Because shorter paths tend to be traversed more quickly, shorter paths tend to accumulate more 
pheromone than longer paths. As more pheromones are deposited on a particular path, more ants 
are likely to select the particular path over other paths. However, because the ants' behavior is 
probabilistic, there is always a chance that an ant may select a path other than the path on which 
the most pheromones have been deposited, thus increasing the probability that other ants will 
also select that other path. 

[0008] By incorporating a similar element of chance, probabilistic routing approaches have 
some advantages over distance vector protocols and link state protocols. Distance vector 
protocols and link state protocols do not provide for alternative paths between an originating 
computer and a destination computer. As a result, these protocols route all traffic between an 
originating computer and a destination computer over the same path, even when the traffic load 
on that path is high, and even when other unused paths between the originating computer and the 
destination computer are available. In contrast, probabilistic routing approaches may send 
portions of such traffic over multiple different paths, thereby balancing the traffic load over the 
paths. 

[0009] Probabilistic routing approaches also recover more quickly from link failures. 
Because distance vector protocols and link state protocols only provide for one path between an 
originating computer and a destination computer at a time, the failure of a link on that path 
causes significant delay while these protocols attempt to re-route the traffic that formerly passed 
through the failed link. In contrast, probabilistic routing approaches quickly adapt to link 
failures as the use of alternative paths is reinforced and the continued use of broken paths is 
undermined. 

[0010] When a new and better path between a source computer and a destination computer 
becomes available, probabilistic routing approaches tend to discover and make use of the new 
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path. In contrast, distance vector protocols and link state protocols tend to ignore new paths in 
favor of established paths, even when the new paths are better than the established paths. 
[0011] However, there are a few drawbacks to probabilistic routing approaches. When the 
load on a best path between an originating computer and a destination computer is low, there is 
little benefit in sending traffic over alternative paths. Indeed, concurrently sending portions of 
traffic over multiple different paths may cause packets to arrive at a destination computer out of 
order, which can require re-transmission of packets. Additionally, previous probabilistic routing 
approaches could not guarantee that paths would be loop-free. 

[0012] Based on the foregoing, there is a clear need for a method of updating network 
routing information so that data packets are routed in a manner that lacks the disadvantages 
inherent in distance vector protocols, link state protocols, and probabilistic routing approaches. 
[0013] More specifically, there is a need for a method of updating network routing 
information so that data packets are routed in a manner that does not always restrict traffic to a 
single path, and in a manner that reduces the routing of traffic over suboptimal paths. 
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BRIEF DESCRIPTION OF THE DRAWINGS 
[0014] The present invention is illustrated by way of example, and not by way of limitation, 
in the figures of the accompanying drawings and in which like reference numerals refer to 
similar elements and in which: 

[0015] FIG. 1 is a block diagram that illustrates an overview of an example system that may 
be used to practice a method of updating a routing table based on an adaptive, deterministic ant 
routing algorithm; 

[0016] FIG. 2A and 2B are flow diagrams that illustrate a high level overview of one 
embodiment of a method of updating a routing table based on an adaptive, deterministic ant 
routing algorithm; 

[0017] FIG. 3A, 3B, 3C, 3D, and 3E are flow diagrams that illustrate one embodiment of a 
method of updating a routing table based on an adaptive, deterministic ant routing algorithm; 
[0018] FIG. 4 is a block diagram that illustrates one embodiment of an ant data packet 
header; 

[0019] FIG. 5 is a flow diagram that illustrates one embodiment of a process for associating 
subnets with destination routers; 

[0020] FIG. 6 is a flow diagram that illustrates one embodiment of a process for discovering 
a router; 

[0021] FIG. 7 is a flow diagram that illustrates one embodiment of a process for discovering 
that a router has been removed from a network; 

[0022] FIG. 8 is a flow diagram that illustrates one embodiment of a process for removing an 
association between a destination router and a subnet; 
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[0023] FIG. 9 is a flow diagram that illustrates one embodiment of a process for associating a 
subnet with a virtual destination router; and 

[0024] FIG. 10 is a block diagram that illustrates a computer system upon which an 
embodiment may be implemented. 
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DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 
[0025] An adaptive, deterministic ant routing approach for updating network routing 
information is described. In the following description, for the purposes of explanation, numerous 
specific details are set forth in order to provide a thorough understanding of the present 
invention. It will be apparent, however, to one skilled in the art that the present invention may 
be practiced without these specific details. In other instances, well-known structures and devices 
are shown in block diagram form in order to avoid unnecessarily obscuring the present invention. 
[0026] Embodiments are described herein according to the following outline: 

1.0 General Overview 

1 . 1 Exploring Paths With Forward Ants 

1 .2 Updating Routing Information With Backward Ants 
2.0 Structural and Functional Overview 

3.0 Method of Updating Network Routing Information Based On an Adaptive, 
Deterministic Ant Routing Algorithm 

3. 1 Exploring Paths and Updating Routing Information 

3.2 Associating Subnets With Destination Routers 

3.3 Determining Neighbor Routers 

3.4 Detecting and Responding to Link Failures and Router Removals 

3.5 Associating a Subnet With a Virtual Destination Router 

3.6 Advertising External Routes 

4.0 Implementation Mechanisms — Hardware Overview 
5 .0 Extensions and Alternatives 

1 .0 GENERAL OVERVIEW 

[0027] The needs identified in the foregoing Background, and other needs and objects that 
will become apparent from the following description, are achieved in the present invention, 
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which comprises, in one aspect, a method of updating a routing table based on an adaptive, 
deterministic ant routing algorithm. 

1 . 1 EXPLORING PATHS WITH FORWARD ANTS 
[0028] According to one aspect of the method, each router in a network periodically sends 
"forward ant" data packets ("forward ants") through each of that router's network interfaces. 
Each forward ant indicates (a) a destination, (b) the identity of the router that sent that forward 
ant, (c) a timestamp, and (d) a "loop-avoidance router" field that initially is set to NULL. 
[0029] When a neighboring router receives a forward ant, the neighboring router inserts the 
forward ant into a queue. Because forward ants share the same queues as other data packets, 
forward ants experience the same delays as other data packets. 

[0030] Each router executes a routing process that updates forward ants received by that 
router. A router's routing process inserts, into a forward ant, (a) the router's identity, and (b) a 
timestamp. As a forward ant is sent from router to router, the forward ant accumulates 
information that indicates (a) the identities of the routers that the forward ant has visited, and (b) 
the time taken for the forward ant to traverse all routers that the forward ant has visited. 
[0031] A router that has just received a forward ant may be called the "present" router 
relative to the forward ant. If the present router is not the forward ant's indicated destination 
("the destination"), then, after updating the forward ant, the present router determines a "next 
hop" for the forward ant. However, the present router does not determine the next hop for the 
forward ant based on the present router's routing table. Instead, the present router determines the 
next hop for the forward ant based on the present router's "pheromone table." 
[0032] In addition to other information, the present router's pheromone table indicates, for 
each possible destination d and each of the present router's neighboring routers k, a predicted 
amount of time that will pass between the sending of a data packet toward neighbor router k and 
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the arrival of that data packet at destination d. Initially, each predicted amount of time is set to 
some specified maximum value that represents infinity. 

[0033] To avoid sending the forward ant to a neighboring router that the forward ant has 
already visited, the present router excludes, from a prospective set of the present router's 
neighboring routers, all neighboring routers that the forward ant has already visited. As 
described above, the forward ant indicates every router that the forward ant has already visited. 
The present router selects a next hop for the forward ant from the exclusive set of neighbor 
routers that the forward ant has not yet visited. As a result, paths will not contain loops. 
[0034] From the exclusive set, the present router selects the neighbor router that is associated 
with the lowest predicted time to reach the destination. The selection is analogous to a real ant's 
selection of a path associated with the greatest pheromone intensity. The selection is 
deterministic rather than probabilistic. If there are no neighbor routers in the exclusive set, or if 
the lowest predicted time is equal to the value that represents infinity, then the present router 
does not send the forward ant to a neighbor router. In that case, the present router terminates the 
forward ant. 

[0035] Otherwise, the present router selects a neighbor router to be the next hop for the 
forward ant. Because only neighbor routers in the exclusive set can be selected, the selected 
neighbor router might not be the neighbor router associated with the lowest predicted time to 
reach the destination. If the selected neighbor router is not associated with the lowest predicted 
time to reach the destination, then the present router updates the forward ant's loop-avoidance 
router field to indicate the present router's identity. Regardless of whether the present router 
updates the loop-avoidance router field, the present router sends the forward ant to the selected 
neighbor router. Thus, the forward ant is sent from router to router towards the destination. 
Each router along the path updates the information carried by the forward ant. 
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1 .2 UPDATING ROUTING INFORMATION WITH BACKWARD ANTS 
[0036] If the present router is the destination, then the present router does not send the 
forward ant to a neighboring router. Instead, the present router generates a corresponding 
"backward ant" data packet ("backward ant") and copies the information contained in the 
forward ant into the backward ant. In addition to this information, the backward ant indicates (a) 
a path feasibility flag that initially is set to a value that represents feasibility and (b) a specified 
expiration time. For example, the specified expiration time may be equal to the sum of the 
current time and a product of a constant value and the time taken for the corresponding forward 
ant to reach the destination. The present router sends the backward ant to the neighbor router 
from which the present router received the corresponding forward ant. 
[0037] A router that has just received a backward ant may be called the "present" router 
relative to the backward ant. The present router determines, based on the backward ant's 
expiration time, whether the backward ant has expired. If the backward ant has expired, then, 
instead of updating the present router's pheromone and routing tables, the present router 
eliminates the backward ant. In this case, the backward ant's information is deemed to be stale. 
[0038] If the backward ant has not expired, then the present router updates the present 
router's pheromone table based on information carried by the backward ant. The router from 
which the present router received the backward ant may be called the "previous router" relative 
to the backward ant. The pheromone table may indicate both "primary" and "alternative" paths 
from the present router, through the "previous router," to the destination. Pheromone table 
information associated with either the primary path or the alternative path is updated. From the 
path information carried by the backward ant, the present router determines whether the present 
router, the destination, or any router in the path between the present router and the destination 
matches a router indicated in the backward ant's loop-avoidance router field. As described 
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above, this field was copied from the corresponding forward ant. If there is not a match, then the 
pheromone table information associated with the primary path is updated. If there is a match, 
then the pheromone table information associated with the alternative path is updated instead. 
[0039] Based on the timestamps contained in the backward ant, the present router updates the 
pheromone table information to indicate a predicted amount of time that will pass between (a) 
the sending of a data packet to the "previous router" and (b) the arrival of that data packet at the 
destination. 

[0040] Based on the value of the path feasibility flag indicated by the backward ant, the 
present router updates the pheromone table information to indicate whether the corresponding 
forward ant's path from the present router to the destination is feasible. 
[0041] The present router also updates, in the pheromone table information, a "potential 
upstream node list." The potential upstream node list may indicate one or more routers, each of 
which is associated with a separate expiration time. Routers found along the corresponding 
forward ant's path towards the present router may be called "potential upstream nodes" relative 
to the present router. If any of the potential upstream nodes are not already in the potential 
upstream node list, then the present router adds those potential upstream nodes to the potential 
upstream node list. The present router associates, with each potential upstream node indicated 
by the backward ant, an expiration time that is equal to the backward ant's expiration time. Any 
of the other potential upstream nodes that have expired are removed from the potential upstream 
node list. 

[0042] The present router determines from the backward ant if the time taken by the 
corresponding forward ant to reach the destination through the previous router is the lowest of 
the pheromone table's predicted times to reach the destination through any of the present router's 
neighboring routers. If so, then the present router also determines if the backward ant's path 
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feasibility flag indicates that the corresponding forward ant's path is feasible. If so, then the 
present router further determines if any of the routers along the corresponding forward ant's path 
between and including the present router and the destination are identified in the potential 
upstream node list associated with the destination. If not, then the present router updates the 
present router's routing table to indicate that data packets addressed to the destination are to be 
forwarded to the previous router. The satisfaction of the above conditions prior to the updating 
of the routing table guarantees that paths based on the routing table are optimal and loop-free. 
[0043] The present router's routing table indicates a neighbor router to which data packets 
addressed to the destination are to be sent. The present router determines if this neighbor router 
is the "previous router." If not, then the present router updates the value of the backward ant's 
path feasibility flag to indicate that the path traveled by the corresponding forward ant is not 
feasible. This is possible because the routing table and the pheromone table, which guides the 
exploration of forward ants, sometimes disagree. For example, a routing table and a pheromone 
table may disagree during convergence. 

[0044] If the present router did not generate the corresponding forward ant, the present router 
determines a next hop for the backward ant. However, the present router does not determine the 
next hop for the backward ant based on the present router's pheromone or routing tables. 
Instead, the present router determines the next hop for the backward ant based on the reverse of 
the corresponding forward ant's path. From the path information copied into the backward ant, 
the present router determines which of the present router's neighbor routers sent the 
corresponding forward ant to the present router. The present router sends the backward ant to 
that neighbor router. Thus, the backward ant is sent from router to router backwards along the 
corresponding forward ant's path, until the backward ant reaches the router that generated the 
forward ant. Each router along the path may update pheromone and routing tables based on the 
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information carried by the backward ant. Each router along the path may update the information 
carried by the backward ant. 

[0045] The updating of the pheromone and routing tables based on information indicated by 
the backward ant is analogous to the way a real ant deposits pheromone along a return path. 
Subsequent forward ants travel paths based on pheromone tables updated based on the backward 
ant's information. However, when pheromone tables are updated, a given path might be 
weakened rather than reinforced. 

[0046] Because pheromone tables may indicate both primary and alternative paths between a 
given router and a given destination, traffic may be sent exclusively over an optimal primary 
path when the traffic load on the primary path is sufficiently low, and traffic may be split and 
balanced between primary and alternative paths when the traffic load on the primary path is 
sufficiently high. Unlike previous approaches, the method described above allows data packets 
to be routed in a manner that does not always restrict traffic to a single path, and in a manner that 
reduces the routing of traffic over suboptimal paths. 

[0047] In other aspects, the invention encompasses a computer apparatus and a computer- 
readable medium configured to carry out the foregoing method. 

2.0 STRUCTURAL AND FUNCTIONAL OVERVIEW 

[0048] FIG. 1 is a block diagram that illustrates an overview of an example system that may 
be used to practice a method of updating a routing table based on an adaptive, deterministic ant 
routing algorithm. A network 100 comprises routers 102-1 14. Any of subnets 1 16-128 may be a 
subnet of network 100 (an "internal subnet"), or a subnet of a network external to network 100 
(an "external subnet"). The system shown is merely an example of many possible different 
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configurations. Other embodiments may include fewer or more system components than those 
illustrated. 

[0049] Router 102 is coupled communicatively to subnet 1 16 and routers 104, 106, and 1 10. 
Router 104 is also coupled communicatively to subnet 118 and routers 108 and 110. Router 106 
is further coupled communicatively to subnet 120 and routers 1 10 and 1 14. Router 108 is also 
coupled communicatively to subnet 122 and routers 1 10 and 1 12. Router 1 10 is further coupled 
communicatively to subnet 124 and router 112. Router 112 is also coupled communicatively to 
subnet 126 and router 114. Router 114 is further coupled communicatively to subnets 126 and 
128. Routers that are directly coupled to each other are "neighbor routers." 
[0050] Each of routers 102-1 14 maintains separate routing information. When a router 
receives a data packet that is destined for a network address to which the router is not directly 
connected, the router consults the routing information to select a next router to which the router 
will forward the data packet. For example, router 104 maintains routing information 136 that 
comprises a routing table 130 and a pheromone table 132. Others of routers 102-1 14 also each 
separately maintain a routing table and a pheromone table. 

[0051] Routing table 130 contains one or more entries. Each entry identifies a destination 
network, a destination router ID that is associated with the destination network, and a next hop 
that is associated with the destination router ID. 

[0052] The destination network identifies a range of destination network addresses. For 
example, the destination network may be an IP network, an IP subnet, an IP supernet, or a single 
IP host. The destination network may identify a range of destination network addresses by 
specifying an address mask, such as a subnet mask, in addition to a network address. 
[0053] The destination router ID uniquely identifies a router within an autonomous system. 
For example, the router ED may be a 32-bit number. According to one embodiment, the router 

-14- 

50325-0802 (Seq. No. 7249) 



identified by the destination router ID may be a virtual router rather than an actual router. 
Virtual routers are described in greater detail below. 

[0054] The next hop indicates an outgoing port that a router should use when forwarding data 
packets to a destination network address contained in the destination network. In broadcast, 
point-to-multipoint, and non-broadcast multi-access ("NBMA") networks, the next hop indicates 
a network address of a next router in a route to the destination network address. 
[0055] For each destination router d other than router 104 in network 100, and for each 
"neighbor" router k that is directly connected to router 104, pheromone table 132 contains a 
separate entry that comprises the following primary path information, where router 104 is router 
i: 

• T k di : an amount of time taken by the forward ant that most recently traveled the path 
from router i, through neighbor router k, to destination router d. 

• PATH k di : a path taken by the forward ant that most recently traveled the path from 
router i, through neighbor router k, to destination router d. The path comprises a list 
of all of the routers along the path, in the order in which those routers were visited. 

k 

• P di : a pheromone intensity associated with the link between router i and neighbor 
router k. The pheromone intensity may be calculated as CI T k di , where C is a positive 
constant value. 

• BW k di : an available bandwidth of the "bottleneck" link in PATH k di . The "bottleneck" 
link in a path is the link that has the least available bandwidth of any link in that path. 

• F k di : a path feasibility flag that indicates whether it is feasible to send data packets 
destined for destination router d through neighbor router k. 
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• PUN di : a potential upstream node list that temporarily indicates routers that are 
potentially "upstream" of router i along a path towards router d, as indicated by one 
or more backward ants that have visited router /. 

• Expiration times associated with PATH k di and routers in PUN di . 

[0056] Additionally, for each destination router d and each "neighbor" router £, pheromone 
table 132 may contain one or more separate entries that each comprise similar information 
regarding alternative paths from router /, through neighbor router k y to destination router d. 
[0057] Each entry in the pheromone table is associated with an expiration time that is 
renewed as ants return over the path associated with the entry. When the expiration time 
associated with an entry has passed, the entry is removed from the pheromone table. Thus, if 
ants stop returning over a path, the entry corresponding to that path expires and is removed from 
the pheromone table. 

[0058] According to one embodiment, one or more of the entries in the pheromone table 
described above may be associated with virtual destination routers rather than actual destination 
routers. Virtual routers are described further below. 

[0059] Forward ants and backward ants are used to explore the best network routes from one 
router to another router. Because each network address in a network is contained in a subnet that 
is associated with a router, a network route between any pair of network addresses can be 
derived from information about routes between each pair of routers in a network. Because 
routers typically comprise just a fraction of all the devices in a network, maintaining routing 
information for network routes between routers is more practical than separately specifying 
routing information for each pair of devices in a network. 

[0060] According to one embodiment, at regular intervals, each one of routers 102-1 14 
asynchronously launches, through each of that router's network interfaces, a forward ant that is 
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addressed to a selected destination router. The destination router may be selected, for example, 
according to a round-robin scheme, with each router in network 100 being selected in turn. The 
destination router may be an actual router or a virtual router. Forward ants share the same router 
queues as non-ant data packets, so forward ants experience the same network conditions that 
other data packets experience. 

[0061] Each forward ant is transmitted through one or more routers towards its destination. 
In response to receiving a forward ant, a router updates the forward ant, as described above in 
section 1.1. After updating the forward ant, the router selects a next hop for the forward ant 
based on the router's pheromone table, and sends the forward ant to the neighbor router selected 
to be the next hop, as described above. 

[0062] As described above, when a destination router specified by the forward ant receives 
the forward ant, the destination router generates a corresponding backward ant. The destination 
router stores the forward ant's information in the backward ant, and eliminates the forward ant. 
Based on the forward ant's information, the backward ant is transmitted through the same one or 
more routers through which the forward ant was transmitted, but in the reverse order. 
[0063] As described above in section 1.2, in response to receiving a backward ant, a router 
may update its routing information, such as that router's pheromone and routing tables, based on 
the forward ant's information that is stored in the backward ant. As described above, the router 
may update additional information, such as a path feasibility flag, that is stored in the backward 
ant. As a result, routing information is updated for each router in a network route through which 
the forward ant was transmitted. 

[0064] FIG. 2A and FIG. 2B are flow diagrams that illustrate a high level overview of one 
embodiment of a method 200 of updating a routing table based on an adaptive, deterministic ant 
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routing algorithm. Such a method may be performed by any of many different devices, such as, 
for example, one or more of routers 102-1 14 described above. 

[0065] In block 202, a forward ant is received. For example, router 104 receives a forward 
ant from router 102, which launched the forward ant. The forward ant specifies router 1 12 as the 
forward ant's destination. 

[0066] In block 204, the forward ant is updated. Continuing the example, router 104 appends, 
to path information contained in the forward ant, a current timestamp and the identity of router 
104. 

[0067] In block 206, a router is selected from among a set of routers. Each router in the set is 
associated with a separate amount of time expected to pass between the sending of a data packet 
toward that router and the arrival of the data packet at the forward ant's destination. The selected 
router is selected over the other routers because of the selected router's association with the 
lowest such amount of time. Continuing the example, router 104 selects one of routers 108 and 
1 10 as a next hop for the forward ant. Consulting pheromone table 132, router 104 determines 
that the amount of time T associated with a path to router 112 through router 108 is lower than 
the amount of time T associated with a path to router 112 through router 1 10. In other words, 
relative to router 1 12, the pheromone intensity P associated with router 108 is greater than the 
pheromone intensity P associated with router 110. Consequently, router 104 selects router 108 
over router 110. 

[0068] In block 208, the forward ant is sent to the selected router. Continuing the example, 
router 104 sends the forward ant to router 108. Each router along the path to router 1 12 updates 
the forward ant. The forward ant travels through router 108 and router 1 10, and arrives at router 
112. Router 1 12 generates a corresponding backward ant and sends the backward ant in the 
opposite direction over the path indicated by the forward ant. 
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[0069] In block 210, a backward ant is received. The backward ant indicates an amount of 
time taken for the corresponding forward ant to travel to the forward ant's indicated destination. 
Continuing the example, the backward ant generated by router 1 12 travels through router 110 
and router 108, and arrives at router 104. The backward ant indicates how long it took for the 
corresponding forward ant to travel from router 104 to router 112. 

[0070] In block 212, the amount of time associated with the selected router is updated based 
on the amount of time indicated by the backward ant. Continuing the example, router 104 
updates pheromone table 132. In pheromone table 132, the path to router 1 12 through router 108 
is associated with the amount of time indicated by the backward ant. In other words, T k di is 
updated, where d is router 112, i is router 104, and k is router 108. The corresponding P k di is also 
updated. 

[0071] In block 214, a path to the destination through the selected router is updated based on 
information contained in the backward ant. Continuing the example, router 104 updates the path 
to router 112 through router 108. Router 104 updates the path to indicate a sequence comprising 
router 104, router 108, router 110, and router 112 instead of the former sequence comprising 
router 104, router 108, and router 1 12. In other words, PATH k di is updated, where d is router 
112, i is router 104, and k is router 108. 

[0072] In block 216, an indication of an amount of bandwidth available on the path is updated 
based on information contained in the backward ant. Continuing the example, router 104 
updates an amount of bandwidth associated with the path to router 112 through router 118. 
Router 104 updates the amount to indicate that a maximum of five units of bandwidth is 
available on the path. This information is indicated in a "bottleneck available bandwidth" field 
of the backward ant, which is updated at each router that the backward ant visits. In other words, 
BW k di is updated, where d is router 1 12, i is router 104, and k is router 108. 
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[0073] In block 218, an indication of the feasibility of the path taken by the forward ant is 
updated based on information contained in the backward ant. Continuing the example, router 
104 updates a path feasibility flag associated with the path to router 112 through router 118. 
Router 108 updates the path feasibility flag to indicate, as the backward ant indicates, that the 
path to router 1 12 through router 1 18 is feasible. Thus, F k di is updated, where d is router 112,/ is 
router 104, and k is router 108. 

[0074] In block 220, a list of routers in a potential upstream node list is updated based on 
information contained in the backward ant. The list of routers in the potential upstream node list 
is updated to indicate all routers in the path taken by the forward ant from (a) the router that 
originally launched the forward ant to (b) the router that sent the forward ant to the present 
router. The present router is the router that received the backward ant data packet in block 210 
above. Continuing the example, router 104 updates a potential upstream node list associated 
with router 112. The potential upstream node list is updated to contain router 102, which 
launched the forward ant and sent the forward ant to router 104. An expiration time associated 
with the backward ant is associated with router 102 in the potential upstream node list. Thus, 
PUN di is updated, where d is router 1 12 and i is router 104. 

[0075] In block 222, the backward ant is updated to indicate the amount of bandwidth 
available on the path taken by the backward ant data packet. Continuing the example, router 104 
determines that the amount of bandwidth available on the output link from router 104 to router 
102 is less than the amount of bandwidth indicated in the backward ant's bottleneck available 
bandwidth field. Therefore, router 104 updates the backward ant's bottleneck available 
bandwidth field to indicate the amount of bandwidth available on the output link from router 104 
to router 102. 
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[0076] In block 224, the routing table is updated based on information contained in the 
backward ant. Continuing the example, router 104 determines from the backward ant and 
pheromone table 132 that the corresponding forward ant's path through router 108 is the most 
optimal loop-free path to router 112. Therefore, router 104 updates routing table 130 to indicate 
that the next hop for data packets destined for router 1 12 is router 108. 
[0077] In block 226, the backward ant is updated to indicate whether the path taken by the 
forward ant data packet is feasible. Continuing the example, router 104 determines that routing 
table 130 indicates that the next hop for data packets destined for router 1 12 is router 108. From 
the backward ant's stored path information, router 104 determines that the backward ant was 
received from router 108. Because the next hop indicated by routing table 130 matches the 
router from which the backward ant was received, router 104 updates the backward ant's path 
feasibility flag to indicate that the path taken by the corresponding forward ant is feasible. 
[0078] In block 228, the backward ant is sent backwards along the forward ant's path. 
Continuing the example, router 104 sends the backward ant to router 102, which sent the 
corresponding forward ant to router 104. 

[0079] The techniques described above are more robust than those employed by other routing 
protocols. Using the techniques described above, optimal, loop-free paths are discovered even if 
some ants are eliminated. Furthermore, because the paths are periodically re-evaluated, the 
techniques described above provide flexibility by rapidly adapting to link failures and network 
congestion. The techniques described above also are less demanding computationally than some 
existing routing protocols. In addition, because techniques described above determine the time 
needed to travel a path based on the actual elapsed time recorded by a forward ant that actually 
traveled the path, these techniques are more accurate in measuring delay than other approaches. 
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Consequently, the above techniques are more accurate in selecting paths that are associated with 
the least delay. 

3.0 METHOD OF UPDATING NETWORK ROUTING INFORMATION BASED ON AN 
ADAPTIVE, DETERMINISTIC ANT ROUTING ALGORITHM 
3.1 EXPLORING PATHS AND UPDATING ROUTING INFORMATION 
[0080] FIG. 3A, FIG. 3B, FIG. 3C, FIG. 3D, and FIG. 3E are flow diagrams that illustrate one 
embodiment of a method 300 of updating network routing information based on an adaptive, 
deterministic ant routing algorithm. Such a method may be performed by any of many different 
devices, such as, for example, one of routers 102-114 described above. 
[0081] In block 302, each neighbor router in a set of neighbor routers is associated with an 
amount of time predicted to be required for a data packet to travel to a specified destination if the 
data packet is transmitted toward that neighbor router. Initially, each neighbor router may be 
associated with a maximum specified time value representing infinity. In block 304, a forward 
ant is received. The forward ant indicates a specified destination. In block 306, the forward ant 
is updated to contain a current timestamp and the identity of the present router. 
[0082] In block 308, a subset of neighbor routers is selected from the set of neighbor routers 
such that the subset contains only neighbor routers that the forward ant has not already visited. 
As described above, routers that the forward ant has already visited are indicated in a list of 
routers contained in the forward ant. 

[0083] In block 310, in response to receiving the forward ant, a neighbor router is selected 
from the subset of neighbor routers. As described above, each neighbor router in the subset is 
associated with a separate amount of time predicted to pass between the sending of a data packet 
toward that neighbor router and the arrival of the data packet at the specified destination. The 
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selected neighbor router is selected over the other neighbor routers in the subset because of the 
selected router's association with the lowest such amount of time among such amounts of time 
associated with neighbor routers in the subset. However, it is possible that neighbor routers 
outside of the subset might be associated with lower such amounts of time. 
[0084] In selecting a neighbor router from the subset of neighbor routers, amounts of time 
associated with primary paths to the specified destination usually are compared. However, if no 
primary path information is associated with a particular neighbor router, then an amount of time 
associated with an alternative path to the specified destination through the particular neighbor 
router may be used in the comparison instead. 

[0085] In block 312, it is determined whether any neighbor router outside of the subset is 
associated with a lower predicted amount of time to the destination than the predicted amount of 
time associated with the selected neighbor router. If so, then control passes to block 316. 
Otherwise, control passes to block 314. 

[0086] In block 314, the forward ant's loop-avoidance router field is updated to indicate the 
present router. Control passes to block 316. 

[0087] In block 316, the forward ant is sent to the selected neighbor router. In block 318, a 
backward ant corresponding to the forward ant is received. The backward ant indicates the 
amount of time taken for the forward ant to travel to the specified destination. 
[0088] In block 320, based on an expiration time indicated by the backward ant, it is 
determined whether the backward ant has expired. If the backward ant has expired, then control 
passes to block 322. Otherwise, control passes to block 324. 

[0089] In block 322, the backward ant is eliminated. Alternatively, in block 324, it is 
determined whether the backward ant's loop-avoidance router field identifies any router that the 
corresponding forward ant visited after visiting the present router. The backward ant's loop- 
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avoidance router field contains the value that was copied from the corresponding forward ant's 
loop-avoidance router field. If the backward ant's loop-avoidance router field does not identify 
any router that the corresponding forward ant visited after visiting the present router, then control 
passes to block 326. Otherwise, control passes to block 328. 

[0090] In block 326, pheromone table information regarding the primary path from the 
present router, through the selected neighbor router, to the specified destination is updated. The 
amount of time associated with this path is updated based on the amount of time taken for the 
corresponding forward ant to travel this path, as indicated by the backward ant. Other primary 
path information also may be updated. Control passes to block 330. 

[0091] Alternatively, in block 328, pheromone table information regarding an alternative path 
from the present router, through the selected neighbor router, to the specified destination is 
updated. Control passes to block 330. 

[0092] In block 330, it is determined, from the pheromone table, whether the predicted 
amount of time to reach the specified destination through the selected neighbor router is lower 
than predicted amounts of time to reach the specified destination through all of the other 
neighbor routers. If so, then control passes to block 332. Otherwise, control passes to block 338. 
[0093] In block 332, it is determined whether the backward ant's path feasibility flag 
indicates that the path taken by the corresponding forward ant is feasible. If so, then control 
passes to block 334. Otherwise, control passes to block 338. 

[0094] In block 334, it is determined, from the backward ant's information, whether the path 
taken by the corresponding forward ant from the present router to the specified destination 
contains any routers that are identified in the present router's potential upstream node list PUN 
for the specified destination. If so, then control passes to block 338. Otherwise, control passes 
to block 336. 
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[0095] In block 336, the routing table is updated to indicate that the next hop for non-ant data 
packets addressed to the specified destination is the selected neighbor router. 
[0096] In block 338, it is determined whether the next hop associated with the specified 
destination in the routing table matches the neighbor router from which the present router 
received the backward ant. If so, then control passes to block 342. Otherwise, control passes to 
block 340. 

[0097] In block 340, the backward ant's path feasibility flag is updated to indicate that the 
path taken by the corresponding forward ant is not feasible. Control passes to block 342. 
[0098] In block 342, the backward ant is sent backwards along the forward ant's path, to the 
neighbor router that sent the corresponding forward ant to the present router. 
[0099] According to one embodiment, each ant is an IP data packet. Each such ant starts with 
a 24-byte header. FIG. 4 is a block diagram that illustrates one embodiment of an ant data packet 
header 450. The first byte 452 contains a version number. The second byte 454 contains a type. 
The type may specify that the ant is a "discovery ant," an "update ant," an "update ant 
acknowledgement," a "forward ant," or a "backward ant." The third and fourth bytes 456 
contain the length of the ant, including the header. The next four bytes 458 identify the router ID 
of the ant's source. The next four bytes 460 are unused, and set to zero. The next two bytes 462 
contain an IP checksum of the contents of the ant, excluding the authentication information 
described below. The next four bytes 464 identify an authentication procedure to be used when 
authenticating the ant. The next eight bytes 466 contain authentication information that the 
specified authentication scheme can use to authenticate the ant. 
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3.2 ASSOCIATING SUBNETS WITH DESTINATION ROUTERS 
[0100] Large networks may comprise many subnets. Manually associating each subnet with 
a destination router would be an onerous task. Moreover, in dynamic networks, routers are 
almost constantly being added and removed. Such additions and removals may require frequent 
changes in associations between destination routers and subnets. Manually updating routing 
information in many routers to reflect correct associations between destination routers and 
subnets would be nearly impossible in some networks. 

[0101] FIG. 5 is a flow diagram that illustrates one embodiment of a process 500 for 
associating subnets with destination routers. Such a process may be performed by any of many 
different devices, such as, for example, one of routers 102-1 14 described above. 
[0102] In block 502, an "update ant" data packet is received. Each update ant identifies a 
destination router and a subnet. For example, router 104 may receive an "update ant" data 
packet from router 102. The update ant may indicate that router 102 is claiming an association 
with, or ownership of subnet 1 16, with which router 102 directly communicates. If only one 
router is connected to a subnet, and all network traffic to the subnet is transmitted through the 
router, then the router is said to "own" the subnet. The subnet may be either internal or external 
to the network of which the router is a part. For example, subnet 116 may be a subnet of 
network 100, or subnet 116 may be a subnet of a network other than network 100. 
[0103] In block 504, in response to receiving the update ant, it is determined whether a 
routing table contains an association between a router and the subnet. Continuing the example, 
in response to receiving the update ant, router 104 may determine whether routing table 130 
contains an association between any router and subnet 116. If the routing table does not contain 
an association between a router and the subnet, then control passes to block 506. Otherwise, 
control passes to block 510. 
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[0104] In block 506, an association between the destination router and the subnet is added to 
the routing table. For example, if router 104 determines that routing table 130 does not yet 
contain an association between any router and subnet 116, then router 104 may add an 
association between router 102 and subnet 116 to routing table 130. 

[0105] In block 508, an update ant is sent to another router. For example, router 104 may 
transmit the update ant to routers 108 and 1 10 so that routers 108 and 1 10 may also update their 
routing tables. According to one embodiment, whenever a router updates its routing information 
according to "newly learned" information, it propagates the newly learned information to other 
routers in the network, as in blocks 506-508. In this way, every router in a network may rapidly 
learn about changes in the network's topology and automatically update its local routing 
information accordingly. 

[0106] In block 510, the device that performs process 500 proceeds to function according to 
the device's configuration. By establishing which destination router "owns" a particular subnet, 
forward ants may be sent to destination routers only, rather than every network device in a 
network. This reduces the overhead involved in updating routing information. 
[0107] According to one embodiment, each update ant contains a sequence of <type, length, 
value> triplets, where each triplet represents a particular type of router information. Some of the 
different types of router information are router ID information, neighbor information, internal 
subnet information, and external subnet information. 

[0108] Router ID information may comprise two separate items. One item is the identity of 
the router to which the information in the update ant refers. The other item is the identity of the 
router that generated the update ant. These items may be the same. However, if the update 
information refers to a virtual router, then the router that generated the update ant is a router that 
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acts as a proxy router for the virtual router. Virtual routers and proxy routers are described in 
greater detail below. 

[0109] Neighbor information may comprise a list of routers that are directly connected to the 
router to which the information in the update ant refers. A particular neighbor router's ID, such 
as the neighbor router's loopback IP address, may identify a particular neighbor router. 
Neighbor information may convey changes in network topology. 

[0110] Internal subnet information comprises a list of internal subnets that a router owns. 
Internal subnets are subnets within the same autonomous system as the router that owns the 
subnets. Routers within the same autonomous system typically use the same routing protocol. A 
separate subnet number and subnet mask may represent each internal subnet. 
[0111] External subnet information comprises a list of external subnets that a router owns. 
External subnets are subnets that are not within the same autonomous system as the router that 
owns the subnets. Routers within different autonomous systems may use different routing 
protocols. A separate subnet number, subnet mask, metric type, and metric value may represent 
each external subnet. Metric types and metric values are described in greater detail below. 
[0112] According to one embodiment, whenever a particular router discovers a new neighbor 
router, the particular router sends all of the particular router's routing information in an update 
ant to the new neighbor router. Thereafter, the particular router sends incrementally updated 
information to the neighbor router when the particular router's routing information changes. 
[0113] For example, when a router determines that a link to a particular subnet can no longer 
be used to transmit data packets to the particular subnet, the router may send an update ant that 
indicates that the link can no longer be used. When neighbor routers receive the update ant, the 
neighbor routers can update their routing information so that data packets no longer will be 
transmitted through a network route that includes the unusable link. 
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[0114] In one embodiment, when a particular router no longer has any neighbors, such as 
when the particular router fails, then each other router removes the particular router from its 
routing information, such as its pheromone table and routing table. 

[0115] According to one embodiment, when a particular router receives an update ant from 
another router, the particular router sends an update ant acknowledgement data packet to the 
other router in response. If a particular router sends an update ant to another router and does not 
receive an update ant acknowledgement data packet from the other router within a specified 
period of time, then the particular router retransmits the update ant to the other router. 

3.3 DETERMINING NEIGHBOR ROUTERS 
[0116] As described above, a particular router may update its routing information based on 
an update ant that is received from another router. The other router might have sent the update 
ant in response to a change in the other router's routing information. Alternatively, the other 
router might have sent the update ant in response to receiving a "discovery ant" data packet from 
the particular router. According to one embodiment, each router in an autonomous system 
broadcasts a discovery ant through each of that router's outgoing ports at specified intervals of 
time, such as every 10 seconds. Periodically transmitted discovery ants serve as a sort of 
"heartbeat" of a particular router by which other routers may discover the addition or removal of 
the particular router from a network. 

[0117] FIG. 6 is a flow diagram that illustrates one embodiment of a process 600 for 
discovering a router. Such a process may be performed by any of many different devices, such 
as, for example, one of routers 102-1 14 described above. 

[0118] In block 602, a discovery ant is received. The discovery ant identifies a particular 
router that transmitted the discovery ant. For example, router 104 may receive a discovery ant 
that identifies router 102 as the sender. In one embodiment, the discovery ant specifies a time- 
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to-live of 1, so that routers that receive a broadcasted discovery ant will not retransmit the 
discovery ant. 

[0119] In block 604, in response to receiving the discovery ant, it is determined whether the 
particular router is identified in a list. For example, router 104 may determine whether router 
102 is identified in a neighbor router list that router 104 maintains. Router 104 may determine 
whether router 102 is associated with any subnet in routing table 130. If the particular router is 
not identified in the list, then control passes to block 606. Otherwise, control passes to block 
610. 

[0120] In block 606, the particular router's identity is added to the list. For example, router 
104 may add router 102' s identity to a neighbor router list that router 104 maintains. Router 104 
may add router 102's identity to routing table 130. 

[0121] In block 608, an update ant is sent to the particular router. The update ant identifies 
destination routers and subnets associated with those destination routers. For example, router 
104 may send an update ant to router 102. The update ant may contain all of router 104's routing 
information, including all of the information in pheromone table 132. 

[0122] In block 610, the device that performs process 600 proceeds to function according to 
the device's configuration. Thus, characteristics of each router in a network may be 
automatically "learned" by each other router in a network. This allows the sending of forward 
ants to many destination routers in a large, dynamic network without manually specifying every 
destination router in a network. 

3.4 DETECTING AND RESPONDING TO LINK FAILURES AND ROUTER 
REMOVALS 

[0123] In a large, dynamic network, routers are often frequently removed. Links between 
routers sometimes fail. Automatically discovering router removals and link failures helps 
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remaining routers to update their routing information quickly so that any interruption in network 
traffic is minimized. FIG. 7 is a flow diagram that illustrates one embodiment of a process 700 
for discovering that a router has been removed from a network. Such a process may be 
performed by any of many different devices, such as, for example, one of routers 102-1 14 
described above. 

[0124] In block 702, it is determined whether a specified amount of time has passed since a 
discovery ant was received from a particular router. For example, router 102 may maintain, for 
each neighbor router in router 102's list of neighbor routers, a separate timestamp that can be 
used to determine elapsed time since a discovery ant was received from that neighbor router. 
Whenever router 102 receives a discovery ant from a neighbor router, router 102 updates the 
timestamp for that neighbor router. If each router in network 100 is configured to broadcast a 
discovery ant packet every N seconds, and at least M • N seconds has passed since router 102 has 
received a discovery ant from router 106, then router 102 may determine that at least M 
consecutive discovery ants have not been received from router 106. If M is greater than a 
specified threshold, then router 102 may conclude that router 106 has been removed from 
network 100. If a specified amount of time has passed since a discovery ant was received from a 
particular router, then control passes to block 704. In other words, if a specified consecutive 
number of discovery ants have not been received from a particular router, then control passes to 
block 704. Otherwise, control passes to block 708. 

[0125] In block 704, the particular router's identity is removed from a list. Continuing the 
example, router 102 may remove router 106' s identity from a list of router 102's neighbor 
routers. Router 102 may remove, from a routing table that router 102 maintains, an association 
between router 106 and subnet 120. 
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[0126] In block 706, an update ant is sent to another router. The update ant indicates that the 
particular router has been removed from the list. Continuing the example, router 102 may send, 
to router 104, an update ant that indicates that router 106 has been removed from network 100. 
In block 708, the device that performs process 700 proceeds. 

[0127] Because a router sends an update ant to the router's neighbor routers whenever the 
router's routing information changes, removal information may be rapidly propagated to every 
other router in the network. FIG. 8 is a flow diagram that illustrates one embodiment of a 
process 800 for removing an association between a destination router and a subnet. Such a 
process may be performed by any of many different devices, such as, for example, one of routers 
102-114 described above. 

[0128] In block 802, an update ant is received. The update ant indicates that a destination 
router has been removed. For example, router 104 may receive an update ant that indicates that 
router 106 has been removed from router 102's list of neighbor routers. 
[0129] In block 804, an association between the destination router and a subnet is removed 
from a routing table in response to receiving the update ant. Continuing the example, in response 
to receiving the update ant, router 104 may remove an association between router 106 and subnet 
120 from routing table 130. 

[0130] In block 806, an update ant is sent to another router. Continuing the example, router 
104 may forward the update ant to routers 108 and 110. Because each router sends an update ant 
to that router's neighbors whenever that router's routing information changes, each router in 
network 100 automatically receives information indicating removal of router 106 and can update 
locally maintained routing information accordingly. 

[0131] Unlike other routing protocols, such as those that use the Bellman-Ford algorithm, 
techniques described herein do not suffer from the "count-to-infinity" problem when a link fails. 
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This is due in part to the fact that, according to the techniques described herein, old paths simply 
time-out unless backward ants return from a destination to which corresponding forward ants 
were sent. Both update ants and the end-to-end path information stored in pheromone tables 
contribute to rapid convergence. 

3.5 ASSOCIATING A SUBNET WITH A VIRTUAL DESTINATION ROUTER 
[0132] Multiple routers may be directly connected to network devices in the same subnet, 
and data packets destined for network devices in the subnet may be transmitted though any of a 
plurality of routers that are so connected. According to one embodiment, a subnet that would be 
associated with multiple destination routers in a routing table is associated with a single virtual 
router instead. The virtual router is information that represents and appears to be an actual router 
with the virtual router's identity. The virtual router's network address may be the subnet address 
of the subnet with which the virtual router is associated. The multiple destination routers that 
otherwise would have been associated with the subnet may act as proxy routers for the virtual 
router. Each proxy router is configured to detect forward ants that are destined for the virtual 
router, and to generate corresponding backward ants. Other routers may send forward ants to a 
virtual router in the same manner that those other routers would send forward ants to an actual 
router. Each proxy router is also configured to periodically transmit, to other routers, forward 
ants that identify the virtual router as the forward ant's originator. 
[0133] FIG. 9 is a flow diagram that illustrates one embodiment of a process 900 for 
associating a subnet with a virtual destination router. Such a process may be performed by any 
of many different devices, such as, for example, one of routers 102-1 14 described above. 
[0134] In block 902, an update ant is received. The update ant identifies a destination router 
and a subnet. For example, router 104 may receive an update ant that indicates that router 1 14 
claims ownership of subnet 126. The subnet may be an external subnet. 
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[0135] In block 904, in response to receiving the update ant, it is determined whether a 
routing table contains an association between the subnet and a router other than the destination 
router. Continuing the example, router 104 may determine whether routing table 130 contains an 
association between subnet 126 and any router other than router 1 14. If the routing table 
contains an association between the subnet and a router other than the destination router, then 
control passes to block 906. Otherwise, control passes to block 912. 
[0136] In block 906, an association that includes the subnet is removed from the routing 
table. Continuing the example, router 104 may remove an association between router 112 and 
subnet 126 from routing table 130. Router 104 may remove, from routing table 130, each 
association between any router and subnet 126. 

[0137] In block 908, an association between the subnet and a virtual (fictional) destination 
router is added to the routing table. Continuing the example, router 104 may add an association 
between subnet 126 and a virtual router to routing table 130. The virtual router may be identified 
by subnet 126's subnet address. Thereafter, routers 112 and 114 are configured to act as proxy 
routers for the virtual router. Routers 1 12 and 1 14 may maintain data structures that indicate that 
routers 112 and 114 are to generate backward ants upon receiving corresponding forward ants 
that are destined for the virtual router. 

[0138] In block 910, an update ant is sent to another router. Continuing the example, router 
104 may send an update ant to routers 102, 108, and 110. The update ant may indicate an 
association between subnet 126 and the virtual router that was added to routing table 130. 
[0139] In block 912, the device that performs process 900 proceeds to function according to 
the device's configuration. Associating subnets with virtual routers greatly reduces the overhead 
required to update routing information, decreases the size of routing information, and hastens the 
selection of network routes. 
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3.6 ADVERTISING EXTERNAL ROUTES 
[0140] Routers that are external to an autonomous system might be configured to use a 
different routing protocol than that used within the autonomous system. When routing 
information that relates to links within an external subnet is being updated, the updated routing 
information should account for the quality of portions of network routes that occur outside of the 
autonomous system. One way of accounting for the quality of such portions is through external 
route advertising. 

[0141] According to one embodiment, update ants that carry external route advertisements 
for each external route are flooded throughout an autonomous system, such as network 100. The 
router that owns an external subnet generated the update ants that carry the external route 
advertisements for routes in the external subnet. As in OSPF, the external route cost metric that 
is advertised for a particular external route may be one of two types. Type 1 metrics are 
comparable to the cost of an intra-autonomous system route. Type 2 metrics are assumed to be 
larger than the cost of any intra-autonomous system route. Routers that own external subnets 
translate an external route cost metric that is advertised according to a protocol, such as Border 
Gateway Protocol, into an additional time delay indicated by the forward ants. As a result, 
router-probability associations may be updated based on the external route cost metric. Border 
Gateway Protocol ("BGP") is described in IETF RFC 1771. 

[0142] The exchange rate between the external route cost metric and the time delay value 
may be specified and adjusted according to a heuristic approach. The cost of an intra- 
autonomous system route, or path, is evaluated based on the quality of the links through which 
the forward ants were transmitted. 

[0143] When more than one router is connected to an external subnet, an association between 
the external subnet and a virtual router may be added to routing tables. The virtual link quality 
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specified by the proxy routers for the virtual router may be based on the external route cost 
metric. If the external route cost metric is Type 1, then the virtual router's ID and the virtual link 
quality are pushed to other routers through forward ants. If the external route cost metric is Type 
2, then the proxy router that advertises the smallest external route metric value transmits a 
backward ant in which a very small delay has been factored into the link quality, and the other 
proxy routers send backward ants in which a maximum delay has been factored into the link 
quality. 

4.0 IMPLEMENTATION MECHANISMS ~ HARDWARE OVERVIEW 
[0144] FIG. 10 is a block diagram that illustrates a computer system 1000 upon which an 
embodiment of the invention may be implemented. The preferred embodiment is implemented 
using one or more computer programs running on a network element such as a router device. 
Thus, in this embodiment, the computer system 1000 is a router. 

[0145] Computer system 1000 includes a bus 1002 or other communication mechanism for 
communicating information, and a processor 1004 coupled with bus 1002 for processing 
information. Computer system 1000 also includes a main memory 1006, such as a random 
access memory (RAM), flash memory, or other dynamic storage device, coupled to bus 1002 for 
storing information and instructions to be executed by processor 1004. Main memory 1006 also 
may be used for storing temporary variables or other intermediate information during execution 
of instructions to be executed by processor 1004. Computer system 1000 further includes a read 
only memory (ROM) 1008 or other static storage device coupled to bus 1002 for storing static 
information and instructions for processor 1004. A storage device 1010, such as a magnetic disk, 
flash memory or optical disk, is provided and coupled to bus 1002 for storing information and 
instructions. 
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[0146] A communication interface 1018 may be coupled to bus 1002 for communicating 
information and command selections to processor 1004. Interface 1018 is a conventional serial 
interface such as an RS-232 or RS-422 interface. An external terminal 1012 or other computer 
system connects to the computer system 1000 and provides commands to it using the interface 
1014. Firmware or software running in the computer system 1000 provides a terminal interface 
or character-based command interface so that external commands can be given to the computer 
system. 

[0147] A switching system 1016 is coupled to bus 1002 and has an input interface 1014 and 
an output interface 1019 to one or more external network elements. The external network 
elements may include a local network 1022 coupled to one or more hosts 1024, or a global 
network such as Internet 1028 having one or more servers 1030. The switching system 1016 
switches information traffic arriving on input interface 1014 to output interface 1019 according 
to pre-determined protocols and conventions that are well known. For example, switching system 
1016, in cooperation with processor 1004, can determine a destination of a packet of data 
arriving on input interface 1014 and send it to the correct destination using output interface 1019. 
The destinations may include host 1024, server 1030, other end stations, or other routing and 
switching devices in local network 1022 or Internet 1028. 

[0148] The invention is related to the use of computer system 1000 for updating a routing 
table based on an adaptive, deterministic ant routing algorithm. According to one embodiment 
of the invention, computer system 1000 provides for such updating in response to processor 1004 
executing one or more sequences of one or more instructions contained in main memory 1006. 
Such instructions may be read into main memory 1006 from another computer-readable medium, 
such as storage device 1010. Execution of the sequences of instructions contained in main 
memory 1006 causes processor 1004 to perform the process steps described herein. One or more 
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processors in a multi-processing arrangement may also be employed to execute the sequences of 
instructions contained in main memory 1006. In alternative embodiments, hard-wired circuitry 
may be used in place of or in combination with software instructions to implement the invention. 
Thus, embodiments of the invention are not limited to any specific combination of hardware 
circuitry and software. 

[0149] The term "computer-readable medium" as used herein refers to any medium that 
participates in providing instructions to processor 1004 for execution. Such a medium may take 
many forms, including but not limited to, non-volatile media, volatile media, and transmission 
media. Non-volatile media includes, for example, optical or magnetic disks, such as storage 
device 1010. Volatile media includes dynamic memory, such as main memory 1006. 
Transmission media includes coaxial cables, copper wire and fiber optics, including the wires 
that comprise bus 1002. Transmission media can also take the form of acoustic or light waves, 
such as those generated during radio wave and infrared data communications. 
[0150] Common forms of computer-readable media include, for example, a floppy disk, a 
flexible disk, hard disk, magnetic tape, or any other magnetic medium, a CD-ROM, any other 
optical medium, punch cards, paper tape, any other physical medium with patterns of holes, a 
RAM, a PROM, and EPROM, a FLASH-EPROM, any other memory chip or cartridge, a carrier 
wave as described hereinafter, or any other medium from which a computer can read. 
[0151] Various forms of computer readable media may be involved in carrying one or more 
sequences of one or more instructions to processor 1004 for execution. For example, the 
instructions may initially be carried on a magnetic disk of a remote computer. The remote 
computer can load the instructions into its dynamic memory and send the instructions over a 
telephone line using a modem. A modem local to computer system 1000 can receive the data on 
the telephone line and use an infrared transmitter to convert the data to an infrared signal. An 
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infrared detector coupled to bus 1002 can receive the data carried in the infrared signal and place 
the data on bus 1002. Bus 1002 carries the data to main memory 1006, from which processor 
1004 retrieves and executes the instructions. The instructions received by main memory 1006 
may optionally be stored on storage device 1010 either before or after execution by processor 
1004. 

[0152] Communication interface 1018 also provides a two-way data communication 
coupling to a network link 1020 that is connected to a local network 1022. For example, 
communication interface 1018 may be an integrated services digital network (ISDN) card or a 
modem to provide a data communication connection to a corresponding type of telephone line. 
As another example, communication interface 1018 may be a local area network (LAN) card to 
provide a data communication connection to a compatible LAN. Wireless links may also be 
implemented. In any such implementation, communication interface 1018 sends and receives 
electrical, electromagnetic or optical signals that carry digital data streams representing various 
types of information. 

[0153] Network link 1020 typically provides data communication through one or more 
networks to other data devices. For example, network link 1020 may provide a connection 
through local network 1022 to a host computer 1024 or to data equipment operated by an Internet 
Service Provider (ISP) 1026. ISP 1026 in turn provides data communication services through 
the worldwide packet data communication network now commonly referred to as the "Internet" 
1028. Local network 1022 and Internet 1028 both use electrical, electromagnetic or optical 
signals that carry digital data streams. The signals through the various networks and the signals 
on network link 1020 and through communication interface 1018, which carry the digital data to 
and from computer system 1000, are exemplary forms of carrier waves transporting the 
information. 
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[0154] Computer system 1000 can send messages and receive data, including program code, 
through the network(s), network link 1020 and communication interface 1018. In the Internet 
example, a server 1030 might transmit a requested code for an application program through 
Internet 1028, ISP 1026, local network 1022 and communication interface 1018. In accordance 
with the invention, one such downloaded application provides for updating a routing table based 
on an adaptive, deterministic ant routing algorithm as described herein. 
[0155] Processor 1004 may execute the received code as it is received and/or stored in 
storage device 1010 or other non-volatile storage for later execution. In this manner, computer 
system 1000 may obtain application code in the form of a carrier wave. 

5.0 EXTENSIONS AND ALTERNATIVES 

[0156] In the foregoing specification, the invention has been described with reference to 
specific embodiments thereof. It will, however, be evident that various modifications and 
changes may be made thereto without departing from the broader spirit and scope of the 
invention. The specification and drawings are, accordingly, to be regarded in an illustrative 
rather than a restrictive sense. 
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